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Abstract 

We propose new concepts in order to analyze and model the dependence structure 
between two time series. Our methods rely exclusively on the order structure of the 
data points. Hence, the methods are stable under monotone transformations of the 
time series and robust against small perturbations or measurement errors. Ordinal 
pattern dependence can be characterized by four parameters. We propose estimators 
for these parameters, and we calculate their asymptotic distributions. Furthermore, 
we derive a test for structural breaks within the dependence structure. All results 
are supplemented by simulation studies and empirical examples. 

For three consecutive data points attaining different values, there are six possibil¬ 
ities how their values can be ordered. These possibilities are called ordinal patterns. 
Our first idea is simply to count the number of coincidences of patterns in both time 
series, and to compare this with the expected number in the case of independence. If 
we detect a lot of coincident patterns, this means that the up-and-down behavior is 
similar. Hence, our concept can be seen as a way to measure non-linear ‘correlation’. 
We show in the last section, how to generalize the concept in order to capture various 
other kinds of dependence. 
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1 Introduction 


In Schnurr (2014) the concept of positive/negative ordinal pattern dependence has been 
introduced. In an empirical study he has found evidence that dependence of this kind 
appears in real-world financial data. In the present article, we provide consistent estima¬ 
tors for the key parameters in ordinal pattern dependence, and we derive their asymptotic 
distribution. Furthermore, we present a test for structural breaks in the dependence struc¬ 
ture. The applicability of this test is emphasized both, by a simulation study as well as 
by a real world data example. Roughly speaking, positive (resp. negative) ordinal pattern 
dependence corresponds to a co-monotonic behavior (resp. an anti-monotonic behavior) of 
two time series. Sometimes an entirely different connection between time series might be 
given. By introducing certain distance functions on the space of ordinal patterns we get 
the flexibility to analyze various kinds of dependence. Within this more general framework 
we derive again limit theorems and a test for structural breaks. 

Detecting changes in the dependence structure is an important issue in various areas 
of applications. Analyzing medical data, a change from a synchronous movement of two 
data sets to an asynchronous one might indicate a disease or e.g. a higher risk for a heart 
attack. In mathematical finance it is a typical strategy to diversify a portfolio in order to 
reduce the risk. This does only work, if the assets in the portfolio are not moving in the 
same direction all the time. Therefore, as soon as a strong co-movement is detected, it 
might be necessary to restructure the portfolio. 

From an abstract point of view, the objects under consideration are two discretely 
observed stochastic processes (X n ) neZ and (Y n ) neZ . In order to keep the notation simple, we 
will always use Z as index set. Increments are denoted by (AX n ) ne z, that is, AX n := X n — 
X n _i. Furthermore, h E N is the number of consecutive increments under consideration. 

The dependence is modeled and analyzed in terms of so called ‘ordinal patterns’. At 
first we extract the ordinal information of each time series. With h + 1 consecutive data 
points ...Xh (or random variables) we associate a permutation in the following way: 

we order the values top-to-bottom and write down the indices describing that order. If 
h was four and we got the data (xq,xi,X 2 ,xs,X 4 ,) = (2,4,1, 7, 3.5), the highest value is 
obtained at 3, the second highest at 1 and so on. We obtain the vector (3,1,4, 0,2) which 
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carries the full ordinal information of the data points. This vector of indices is called the 
ordinal pattern of (x 0 , Xh )• A mathematical definition of this concept is postponed to the 
subsequent section. There, it also becomes clear how to deal with coincident values within 
(x 0 , ■■■iXh). The reflected vector (—x 0 ,..., — Xff) yields the inverse pattern, that is, read the 
permutation from right to left. In the next step we compare the probability (in model 
classes) respectively the relative frequency (in real data) of coincident patterns between 
the two time series. If the (estimated) probability of coincident patterns is much higher 
than it would be under the hypothetical case of independence, we say that the two time 
series admit a positive ordinal pattern dependence. In the context of negative dependence 
we analyze the appearance respectively the probability of reflected patterns. The degree of 
this dependence might change over time: we see below that structural breaks of this kind 
show up in the dependence between the S&P 500 and its corresponding volatility index. 

Ordinal patterns have been introduced in order to analyze large noisy data sets which 
appear in neuro-science, medicine and finance (cf. Bandt and Pompe (2002), Keller et al. 
(2007), Sinn et al. (2013)). In all of these articles only a single data set has been considered. 
To onr knowledge the present paper is the first approach to derive the technical framework 
in order to use ordinal patterns in the context of dependence structures and their structural 
breaks. 

The advantages of the method include that the analysis is stable under monotone trans¬ 
formations of the state space. The ordinal structure is not destroyed by small perturbations 
of the data or by measurement errors. Furthermore, there are quick algorithms to analyze 
the relative frequencies of ordinal patterns in given data sets (cf. Keller et al. (2007), Sec¬ 
tion 1.4). Reducing the complexity and having efficient algorithms at hand are important 
advantages in the context of Big Data. Furthermore, let us emphasize that unlike other 
concepts which are based on classical correlation, we do not have to impose the existence 
of second moments. This allows us to consider a bigger variety of model classes. 

The minimum assumption in order to carry out our analysis is that the time series 
under consideration are ordinal pattern stationary (of order h), that is, the probability for 
each pattern remains the same over time. In the sections on limit theorems we will have to 
be slightly more restrictive and have to impose stationarity of the underlying time-series. 
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Obviously stationarity of a time series implies stationary increments, which in turn implies 
ordinal pattern stationarity. 

The paper is organized as follows: in Section 2 we present the rigorous definitions 
of the concepts under consideration. In particular we recall and extend the concept of 
ordinal pattern dependence. For the reader’s convenience we have decided to derive the 
test for structural breaks first for this classical setting. In order to show the applicability 
of the proposed test we consider financial index data. It is then a relatively simple task 
to generalize our results to the more general framework which is described in Section 
3. There, we consider the new concept of average weighted ordinal pattern dependence. 
Some technical proofs have been postponed to Section 4. In Section 5 we present a short 
conclusion. 

From the practical point of view, our main results are the tests on structural breaks 
(cf. Theorem 2.7 and its corollary) and the generalization of the concept of ordinal pattern 
dependence (Section 3). In the theoretical part the limit theorems for all parameters under 
consideration, in particular for p, are most remarkable (cf. Corollary 2.6). 

The notation we are using is mostly standard: vectors are column vectors and ' denotes 
a transposed vector or matrix. In defining new objects we write ‘:=’ where the object to 
be defined stands on the left-hand side. We write M + for [0, oo). 

2 Methodology 

First we fix some notations and the basic setup. Afterwards we present limit theorems for 
the parameters under consideration as well as our test on structural breaks. 

2.1 Definitions and General Framework 

Let us begin with the formal definition of ordinal patterns: let h G N and x = (x'o, op,..., Xh) G 
The ordinal pattern of x is the unique permutation II(x) = (r 0 , rq,..., r^) G Sh+ 1 
such that 

(i) x ro > x ri > ... > x rh and 

(ii) rj- 1 > rj if x r:i _ x — x rj for j G {1,..., h}. 
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For an element 7 r G Sh+i, m( tt) is the reflected permutation , that is, read the permutation 
from right to left. 

Let us now introduce the main quantities under consideration: 
p := P(u(X ni X n+ i, ...,X n+h ) = II (Y n , Y n+ i,... 

Q ■= J2nes h+1 P ( U ( X m X n+1, ■■■, X n+h ) = TT ) ■ P(ll{Y n ,Y n+1 , ...,Y n+h ) = 7r) 

r := p(n(X n ,X n+ 1 ,...,X n+h ) = m(U(Y n ,Y n+1 , ...,Y n+h )) j 

S :=E W . e S h+1 P { U( y X ni X n+l,-;X n+h ) = TT ) ■ P (m(U(Y n ,Y n+1 , ...,Y n+h )) = TT j 
The time series A" and Y exhibit a positive ordinal pattern dependence (ord©) of order 
he N and level a > 0 if 

p > a + q 

and negative ordinal pattern dependence (ord©) of order he N and level (3 > 0 if 

r > fl + s. 

Let us shortly comment on the intuition behind these concepts: we compare the proba¬ 
bility of coincident (resp. reflected) patterns in the time series {p, r} with the (hypothetical) 
case of independence {q, s}. In order to have a concept which is comparable to correlation 
and other notions which describe or measure dependence between time series, we introduce 
the following quantity 

which is called the standardized ordinal pattern coefficient. It has the following advantages: 
we obtain values between -1 and 1, becoming -1 resp. 1 in appropriate cases: let Y be a 
monotone transformation of X where X is a time series which admits at least two different 
patterns with positive probability. In this case 

or d( X, Y) = ((©j) + “ ( 737 ) + = ! (9. s < !)■ 

In general q becomes 1, only if the time series X and Y both admit only one pattern tt with 
positive probability (which is then automatically 1). In this case we would set ord(A", Y) = 
1, since this situation corresponds to a perfect co-movement. A similar statement holds 
true for s in the case of anti-monotonic behavior. 
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Using the standardized coefficient, the interesting parameters are still p and r. If the 
time series X and Y under consideration are stationary, q and s do not change over time 
also. Recall that we do not want to find structural breaks within one of the time series, 
but in their dependence structure. In the context of change-points respectively structural 
breaks within one data set cf. Sinn et al. (2012). 

Remark 2.1. It is important to note that our method depends on the definition of ordinal 
patterns which is not unique in the literature. In each case permutations are used in order 
to describe the relative position of h + 1 consecutive data points. Most of the time the 
definition which we have given above is used. In Sinn et al. (2012), however, time is 
inverted while Bandt and Shiha (2007) use an entirely different approach which they call 
‘order patterns’. Using their definition, the reffected pattern is no longer derived by reading 
the original pattern o from the right to the left, but by subtracting: (h + 1,..., h + 1) — a. 
However, the quantities p and q are invariant under bijective transformations (that is: 
renaming) of the ordinal patterns. Therefore, our results remain valid whichever definition 
is used. 

Given the observations (aq, jq),..., (x n , y n ), we want to estimate the parameters p, q , r, s, 
and to test for structural breaks in the level of ordinal pattern dependence. In the subse¬ 
quent section, we will propose estimators and test statistics, and determine their asymptotic 
distribution, as n tends to infinity. Readers who are only interested in the test for structural 
breaks and its applications might skip the next subsection. 


2.2 Asymptotic Distribution of the Estimators of p 

The natural estimator of the parameter p is the sample analogue 


Pn = 


n 


n—h 

E> 

i= 1 


(n (x i ,..,x i+h )=n(r i ,...,y i+h )}- 


( 2 ) 


The asymptotic results in our paper require some assumptions regarding the dependence 
structure of the underlying process (X i: Yi) i£ z- Roughly speaking, our results hold if the 
process is ‘short range dependent’. Specifically, we will assume that (X tl Yi) ieZ is a func¬ 
tional of an absolutely regular process. This assumption is valid for many processes arising 
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in probability theory, statistics and analysis; see e.g. Borovkova, Burton and Dehling (2001) 
for a large class of examples. 

For the reader’s convenience we recall the following concept: let (fl, P, P) be a proba¬ 
bility space. Given two sub-u-fields A, B C P, we define 

(3(A,B) = sup^T |P(A n Bj) - P(A)P(P,)|, 

ij 

where the sup is taken over all partitions A±,..., Aj G A of Q, and over all partitions 
E B of fh The stochastic process ( Zi) ie z is called absolutely regular with 
coefficients (/S m ) m >i, if 

A» := sup/Jf^, TT+m+i) -> 0, 

n&L 

as m —* oo. Here T l k denotes the a-held generated by the random variables ..., Z\. 

Now we can state our main assumption. We will see below that it is very weak and 
that the class under consideration contains several interesting and relevant examples. 

Let (Xj, Yi)i >i be an Revalued stationary process, and let (Z’i)iez a stationary process 
with values in some measurable space S. We say that (X t} Y))j>i is a functional of the 
process ( Zi) ie z , if there exists a measurable function / : S z —* R 2 such that, for all k > 1, 

{X k ,Y k ) = f{{Z k+i ) ie z). 

We call (Xj,Y))i>i a 1-approximating functional with constants (a m ) m >i, if for any m > 1, 
there exists a function f m : S 2m+1 —> R 2 such that (for every i G Z) 

E\\(Xi, Yi ) - f m (Zi- m , • • •, Z i+m )|| < a m . (3) 


Note that, in the Econometrics literature 1-approximating functionals are called Li¬ 
near epoch dependent (NED). The following examples show the richness of the class under 
consideration. Recall that every causal ARMA(p, q) process can be written as an MkL(oo) 
process (cf. Brockwell and Davis (1991) Example 3.2.3.). 

Example 2.2. (i) Let (Xj)^! be an MA(oo) process, that is, 

OO 

Xi = ajZi_j 

3=0 
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where (ct/)j>o are real-valued coefficients with 'Y^L :I < oo, and where (Zi)iez is an i.i.d. 
process with mean zero and finite variance. (Xj)j>! is a 1-approximating functional with 
coefficients a m = i a j) • Limit theorems for MA(oo) processes require that the 

sequence decreases to zero sufficiently fast. The minimal requirement is usually 

that the coefficients (ay)j>o are absolutely summable. If this condition is violated, the 
process may exhibit long range dependence, which is e.g. characterized by non-normal 
limits and by a scaling different from the usual y^n-scaling. Let us remark that ordinal 
pattern distributions in (a single) ARM A time series have been investigated in Bandt and 
Shiha (2007) Section 6. 

(ii) Consider the map T : [0,1] —» [0,1], defined by T(ui) = 2u mod 1, i.e., 

$ 2u if 0 < cu < 1/2 
T(u) = < 

[ 2cu - 1 if 1/2 < u < 1. 

This function is well known as the one-dimensional baker’s map in the theory of dynamical 
systems. Let g : [0,1] -> 1 be a Lipschitz-continuous function, and define the stochastic 
process {X n ) n > 0 by 

X n {u>) = g{T n {u>)). 


This process was studied by Kac (1946), who established the central limit theorem for 
partial sums Y^=i under the assumption that g is a function of bounded variation. 
The time series (X n ) n > 0 is a 1-approximating functional of an i.i.d. process (Zj)j e z with 
approximating constants a m = ||g||£/2 m+1 where ||-|| L denotes the Lipschitz norm. 

(iii) The continued fraction expansion provides an example from analysis that falls under 
the framework of the processes studied in this paper. It is well known that any u 6 (0,1] 
has a unique continued fraction expansion 


u = 


a i 


CL2 + - 


■3 + " 


where the coefficients a*, i > 1, are non-negative integers. Since these coefficients are 
functions of uj, we obtain a stochastic process (Zj)j>!, defined on the probability space 
= (0,1] by Zi{u>) = di . If we equip (0,1] with the Gaufi measure 

M(M) = k^log(l + x), 



the process {Zf)i >i becomes a stationary ^-mixing process. We can then study the process 
of remainders 


XJu) = 


Z n (u) + 


J n -\-1 




'n+2 


(")H 


The process (A n ) n >! is a 1-approximating functional of the process (Zj)j> i, and thus the 
results of the present paper are applicable to this example. 


Remark 2.3. At first glance, it might be a bit surprising that examples from the theory of 
dynamical systems are treated in an article which deals with the order structure of data. In 
fact, there is a close relationship between these two mathematical subjects: using ordinal 
patterns in the analysis of time series is equivalent to dividing the state-space into a finite 
number of pieces and using only the information in which piece the state is contained at 
a certain time. This is known as symbolic dynamics in the theory of dynamical systems. 
Each of these pieces is assigned with a so called symbol. Hence, orbits of the dynamical 
system are turned into sequences of symbols (cf. Keller et al. (2007), Section 1.2). 

Processes that are 1-approximating functionals of an absolutely regular process satisfy 
practically all limit theorems of probability theory, provided the 1-approximation coef¬ 
ficients a m and the absolute regularity coefficients (3k decrease sufficiently fast. In our 
applications below, we are not so much interested in limit theorems for the (A*, Yj)-process 
itself, but in limit theorems for certain functions g((Xi,Yf ),..., (X i+ h, Y i+ h)) of the data. 
We then have to show that these functions are 1-approximating functionals, as well. We 
will now state this result for two functions that play a role in the context of the present 
research. A preliminary lemma, along with its proof, is postponed to Section 4. 


Theorem 2.4. Let (A, ; , be a stationary 1-approximating functional of the absolutely 

regular process {Zf)i>Let ((3(k))k >i denote the mixing coefficients of the process (2h);>i, 
and let (ak)k >i denote the 1-approximation constants. Assume that 

OO 

(3(h)) < 00. (4) 

fc=i 

Furthermore, assume that the distribution functions of X, — X 1 , and of Y t — lj , are both 
Lipschitz-continuous, for any i e {1,..., h + 1}. Then, as n —* oo, 

Vn(p n - p) N(0, o- 2 ), (5) 


9 



where the asymptotic variance is given by the series 


cr 


Var(l { n ( xi.x h+1 )=n(yi.y ft+1 )}) 


( 6 ) 


oo 

+ 2 X] Cov ( 1 {n(Xi J ...,x fc+ i)=n(yi J ...,y h+ i)}, l{n(x m ,..,x m+h )=n(y m ,...,y m+h )}) , 

m =2 


Proof. We apply Theorem 18.6.3 of Ibragimov and Linnik (1971) to the partial sums of the 
random variables 

& := 1 {n(x i ,...,x i+h )=n(y i ,...,y i+fe )}- 

By Lemma [4.11 we get that is a 1-approximating functional of the process (Zf) j>! with 
approximation constants (^fak)k> i- Thus, the conditions of Theorem 18.6.3 of Ibragimov 
and Linnik (1971) are satisfied, and hence (|5]) holds. □ 


Remark 2.5. Theorem EJ holds under the assumption that the underlying time series 
(Xj, Yi)i >i is short range dependent. In the case of long-range dependent time series, other 
limit theorems hold, albeit with a normalization that is different from the standard y/n- 
normalization. 


In order to determine asymptotic confidence intervals for p using the above limit theo¬ 
rem, we need to estimate the limit variance a 2 . De Jong and Davidson (2000) have proposed 
a kernel estimator for the series on the r.li.s. of ([6]). Let k : 1R. —> [0,1] be a symmetric 
kernel, i.e. k(—x) = k(x), that is continuous in 0 and satisfies /c(0) = 1, and let (fe n )n>i be 
a bandwidth sequence tending to infinity. Then we define the estimator 

^^(l{n(x i ,...,A^)=n(y,...,y i+ft )}-Pn)(l{n(^,...,A' J+fe )=n(y j ,...,y i+ ,)}-Pn)- 

(7) 

De Jong and Davidson (2000) show that a 2 is a consistent estimator of a 2 , provided some 
technical conditions concerning the kernel function k, the bandwidth sequence (6 n ) n >i and 
the process (X t , 17);>i hold. The assumptions on the process follow from our assumptions. 
Concerning the kernel function and the bandwidth sequence, a possible choice is given 
by k(x) = (1 — |x|)l[_i ! i](a;) and b n = log(n). We thus obtain the following corollary to 
Theorem 12.41 
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Corollary 2.6. Under the same assumptions as in Theorem \2.4 

\/n{p n ~ P ) v 


(J j) 


N( 0,1). 


As a consequence, [p n — z a d n ,p n — z Q d n \ is a confidence interval with asymptotic coverage 
probability (1—a). Here z a denotes the upper a quantile of the standard normal distribution. 


We complement this theoretical result with a simulation of two correlated standard 
normal AR{1) time series, where the A/2-parameter is 0.1. Furthermore we have set 
h — 2, p — 0.6353, n = 1000, k(x) and b n as above. We have simulated this 1000 times 
obtaining the following histogram and Q-Q plot. 


Histogram of sqrt(n) * (p_n - 0.6353)/sigma_n 



Figure 1: Histogram of \fn{fi n —p)/cr n for 
1000 simulations of correlated AR(1) time 
series and density of N(0,1) distribution. 


Normal Q-Q Plot 



Figure 2: Q-Q plot of \/n{p n — p)/a n for 
1000 simulations of correlated AR(1) time 
series and N(0,1) distribution. 


2.3 Structural Breaks 

As we have pointed out above the interesting parameter, in order to detect structural breaks 
in the dependence structure, is p. If p changes significantly over time, r has to change also. 
Furthermore, in order to analyze r one can instead analyze p for X and —Y. For stationary 
time series, the values of q and s are stationary over time, too. 


11 





























In order to test the hypothesis that there is no change in the ordinal pattern dependence, 
we propose the test statistic 


T 

1 r> 


1 

max —= 

0<k<n—h yjTi 


k 

Y ( 1 {n(x i ,...,A: i+ h)=n(y i 
1=1 


■Xi+h )} P n ) 


and prove limit theorems which are valid under the hypothesis. 


( 8 ) 


Theorem 2.7. Under the same assumptions as in Theorem\2.4\ we have 


T 

1 n 


v 


a sup |W(A) - AW(1)|, 

0<A<1 


where a is defined in (EJ) , and where (IK(A))o<a<i is standard Brownian motion. 


The proof is again postponed to Section 4. 


Corollary 2.8. Under the same assumptions as in Theorem 2.4. we have 


=-T n sup |VF(A) — AW'(1)|, 

On 0<A<1 


where a n is defined in (J7J) , and where (IK(A))o<a<i is standard Brownian motion. 


Remark 2.9. Note that the distribution of sup 0<A<1 |IK(A) — AIK(1)| is the Kolmogorov 
distribution. If we denote the upper a quantile of the Kolmogorov distribution by k a , the 
test that rejects the hypothesis of no change when T n /a n > k a has level a. 

Example 2.10. Again we complement the theoretical result with a simulation study. In 
both cases we have simulated two correlated Ai?(l) time series, where the AA-parameter 
is 0.2. Furthermore we have set h — 2, n — 1000, k(x) and b n as above. In the first 
time series (Figure 3), there is no structural break (p = 0.6353). In the second time series 
(Figure 4) we have set p = 0.6353 for the first 500 data points and p = 0.5378 for the 
second 500 data points. We have simulated both pairs of time series 1000 times. Recall 
that the 0.95 quantile of the Kolmogorov distribution is 1.36. 

Let us, furthermore, analyze empirically the power of the test under different sizes of 
the change: we have used the same setting as above and obtain in Figure 5 the power of 
the test for various values of p after the break. 
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Histogram of T_n/sigma_n 


Histogram of T_n/sigma_n 




T_n/sigma_n 


T_n/sigma_n 


Figure 3: Histogram of T n /cr n for 1000 sim¬ 
ulations of correlated AR( 1) time series 
without structural break and Kolmogorov 
density. 


Figure 4: Histogram of T n /a n for 1000 sim¬ 
ulations of correlated AR( 1) time series 
with a change of p after 500 observations 
and Kolmogorov density 



0.55 0.60 0.65 0.70 

value_of_p_after_500 


Figure 5: Empirical power of the test for structural breaks for different values of p after 
500 data points. 

We now work with simulated data sets which have been generated under three distinct 
settings: the normal distribution, the Student-t distribution with 2 degrees of freedom and 
the Cauchy distribution. For 500, 1000 and 2000 data points, we analyze structural breaks 
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after 1/4, 1/3 respectively 1/2 of the data. For the resulting AR(l)-time series with </> = 0.2 
as above we analyze changes in p from 0.635 to 0.437. 


n=500 n=1000 n=2000 


break 

Normal 

Student-t 

Cauchy 

break 

Normal 

Student-t 

Cauchy 

break 

Normal 

Student-t 

Cauchy 

125 

0.628 

0.611 

0.559 

250 

0.938 

0.891 

0.861 

500 

0.998 

0.998 

0.996 

167 

0.776 

0.769 

0.71 

333 

0.979 

0.973 

0.958 

667 

1 

0.999 

1 

250 

0.877 

0.851 

0.81 

500 

0.997 

0.992 

0.984 

1000 

1 

1 

1 


Let us emphasize that in medical and financial data n=2000 is a reasonable number 
which is often obtained. It is surprising that we get strong results even in the highly 
irregular Cauchy setting. 

Finally, we use our method on real data. 

Example 2.11. Let us consider the S&P 500 and its corresponding volatility Index VIX. We 
cannot go into the details of the Chicago Board Options Exchange Volatility Index (VIX), 
but we give a short overview: the index was introduced in 1993 in order to measure the 
US-market’s expectation of 30-day volatility which is implied by at-the-money S&P 100 
option prices. Since 2003, the VIX is calculated based on S&P 500 data (we write SPX for 
short). The VIX is often qualified as the ‘fear index’ in newspapers, TV shows and also in 
research papers. It has been discussed whether the VIX is a self-fulfilling prophecy or if 
it is a good predictor for the future anyway (cf. Whaley (2008), and the references given 
therein). For us the following facts are of importance: 


• The VIX can be used to measure the market volatility at the moment it is calculated 
(instead of trying to predict the future). 

• Whether we use the S&P 100 or the S&P 500 data makes no difference, they are ‘for 
all intents and purposes (...) perfect substitutes’ (Whaley (2008), p.3). 

• The relation between the two datasets (SPX-B-VIX) is difficult to model (cf. Madan 
and Yor (2011)). 

• There is a negative relation between the datasets which is asymmetric and hence, in 
particular, not linear (cf. Whaley (2008), Section IV). 

We have used open source data which we have extracted from hnance.yahoo.com. We 
have analyzed the daily ‘close prices’ for two periods of time each consisting in 2000 data 
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points for h = 2. In the time period from 1990-01-02 (the first day for which the VIX has 
been calculated) until 1997-11-25 we obtain T^ooo/dgooo = 0.843. In the time period from 
1997-11-26 to 2005-11-08 we get T 2 000/02000 = 1-5174. Hence, our test suggests that there 
has been a structural break in the dependence between the two time series in this second 
time period (level a = 0.05). Recall that the so called dot-com bubble falls in the second 
time period. The effect gets weaker as h increases. However, for h = 3 resp. h = 4 we still 
get significant results in case of the second time period, namely, T^ooo/dgooo is 1.4898 resp. 
1.3616. Let us have a closer look on the values of 

i 

/ . ( 1 {n(x i ,...,x i+h )=n(y i ,...,v i+ft )} - Pn) 


y/na„ 


i =1 


before the maximum in (JHJ) is taken. The vertical line is the 0.95-quantilc of the Kolmogorov 
distribution. 




Figure 6: No structural break is detected Figure 7: In the second time period a struc- 
in the first 8 year period. tural break is detected. 

2.4 Estimating the Other Parameters 

Now we deal with the other parameters under consideration in order to estimate the stan¬ 
dardized ordinal pattern coefficient. 
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To estimate the parameter q, we define the following auxiliary parameters 


qxir) 

= nn(x 1? . 

•.,X h ) = vr) 

(9) 

9V( 7r) 

= P(n(yi,.. 

• ,W) = vr). 

(10) 


where n G S^+i denotes a permutation. Note that we have the following identity 


9 = X ?A'(vr)gy(7r). 

n&Sh 

We estimate the parameters qx{j r) and qy(7 r) by their sample analogues 

^ n—h 

g.\-(vr) = - X 1 { 1 r(A i ,...,X i+h )=7r} 

i =1 
^ n—h 

qy( n ) = -^2 1 MY i ,...,Y i+h )=7T}, 

i =1 


and finally q by the plug-in estimator 


Qn = X ^'( 7F )^'( 7r ) 
n£S h 


( 11 ) 

( 12 ) 

(13) 


Theorem 2.12. Under the same conditions as in Theorem 2-4, the random vector 


y/n{{qx{n) - qx(x)) neSh , (M 7 0 ~ 

converges in distribution to a multivariate normal distribution with mean vector zero and 
covariance matrix 



where the entries of the (n\ x n\) block matrices Sn = (cri 1 ,) . _ , £i 2 = 

' '‘J 7 * ' 71,71 Go/* 

and E 22 = (er 22 ,) , 0 ore given the following formulas 

' ’ ' 71,71' 

OO 

frr 12 'l 

V 71,71'/ n ^ n /(zS h ’ 

= X] Cov ( 1 WXi,...,x h )= w },lwx fc+11 ...,x fc+h )=^}) 

k=— oo 

(14) 

oo 

= X CoV ( 1 «^i,-,A h )=7r},l{7r(y fc+1 ,...,y fc+fe )=7r'}) 
k=—oo 

(15) 

oo 

= X Cov ( 1 M y i----T/ l )=^}) 1 Wn +1 ,...,y fc+ h)=^'})- 

(16) 


k =—oo 
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Proof. This follows from the multivariate CLT for functionals of mixing processes, which 
can be derived from Theorem 18.6.3 of Ibragimov and Linnik (1971) by using the Crarner- 
Wold device. □ 


Remark 2.13. We have presented the formulas (fl4)l - (fl6l) for the asymptotic covariances for 
the case when the underlying process (X k ,Y k ) ke % is two-sided. In the case of a one-sided 
process (X k ,Y k ) k > i, the formulas have to be adapted. E.g., in this case (fT4l) becomes 


r' - Cov(l {7r ( Xl ,...,X h )=7T}, l {-K{Xx,...,X h )=n'}) 

oo 

+ ^2 CoV ( 1 U(X 1 „..,X h )=7r}, 1{tt (X k+1 ,...,X k+h )=n'}) 
k= 1 
oo 

+ ^ Cov(l {n{Xl ,...,X h )=-K'}i l{7T{X k+1 ,...,X k+h )= 7T}) 


fc=l 


Using Theorem 12.121 and the delta method, we can now derive the asymptotic distribu¬ 
tion of the estimator q n , defined in (fT3jh The proof can be found in Section 4. 


Theorem 2.14. Under the same assumptions as in Theorem\2.4 


Vn{q n -?)->• iV( 0 , 7 2 ), 


where the asymptotic variance y 2 is given by the formula 


U 2 = + 2 ^'( 7r ) a ^, g r ( 7r ') + ^( 7r ) a ^'^( 7r 0 

7 T,lT f (E:Sh 7T,7f'ESfr 7 T,n'£Sh 

If we want to apply the above limit theorems for hypothesis testing and the determi¬ 
nation of confidence intervals, we need to estimate the limit covariance matrix X. We will 
again apply the kernel estimate, proposed by De Jong and Davidson (2000), using the same 
kernel k and the same bandwidth (5 n ) n >i as before. We define the M 2 ^ +1,! -valued random 
vectors 

Vi = ((l {l r(y,...,X l+t )=h - qx(n)) n£Sh+i , (1 {n(Y i ,...,Y i+h )=n} ~ &{*)) veSh+1 ) ■ 


The kernel estimator for the covariance matrix X is then given by 


1 n—h n—h 

s» = -XXUTUv i v’-. 


i=1 1=1 
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We denote the entries of estimated covariance matrix by af\,(n),c and 
respectively, where 7r,7r' E Sf l+1 . Plugging the estimated covariances into the formula for 
y 2 , we then obtain a consistent estimator for 7 2 . 


+ 2 ^( ?r ) 



tr,n'£Sh 


n,n'eS h 


ir,n'eSh 


Corollary 2.15. Under the same assumptions as in Theorem\2.14 



In 


As a consequence, [q n — z a %, q n — z a fi n \ is a confidence interval with asymptotic coverage 
probability (1—a). Here z a denotes the upper a quantile of the standard normal distribution. 

Remark 2.16. (i) The coefficients r, s can be estimated in the same way as p, q, by applying 
the estimators for p and q to the process (X,-, —YJ;)i>i- E.g., we can estimate r by 


n — h 



i =1 


(ii) The standardized ordinal pattern coefficient ord(A", Y) can be estimated by the plug-in 
estimator 



If P 7^ q an d r / s, we can establish asymptotic normality of ord(A", Y) using the delta 
method. 

3 Weighted Ordinal Pattern Dependence 

As we have pointed out in the introduction, positive ordinal pattern dependence only counts 
the occurrence of coincident patterns. In the case of large values of h it might happen that 
there is a strong co-movement of the two time series under consideration, which is distracted 
by a small noise. This might lead to ‘almost similar’ patterns, a term which will be made 
precise below. 

Besides, we might be interested in an entirely different dependence structure between 
two time series. We will see that our general approach yields a powerful tool to introduce 
and analyze various kinds of dependence. 
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3.1 Different Kinds of Dependence 

Let us begin with the following example: 




The difference between the corresponding permutations is only one neighboring trans¬ 
position. In this sense the permutations are very close to each other. However, one has 
to be very careful with the meaning of ‘close to each other’. For h = 4 the permutations 
(1,3, 2,0,4) and (3,1,2,4,0) differ only by two transpositions. Nevertheless, they look 
almost like ordO. 

If the distance is chosen appropriately, (e.g. t' 1 -metric, see below) a small distance 
on Sh+i can be interpreted as a strong co-movement. Hence, we introduce a decreasing 
function w on d(Sh+i, Sh+i), the image of the metric. This function will be called weight 
function. In the case described in Section 1 the distance function is the discrete metric and 
the weight function is w = 1{ 0 }. 

In the present section, we only consider positive dependence. The case of negative 
dependence can be treated in the same way, or by using positive dependence on X and 
—Y. 

Let us directly consider the most general setting. We will see below that it is sometimes 
useful to consider different types of patterns to be close to each other. Hence, we allow any 
metric on Sh+i, and even every pseudo-metric. The reduction of complexity is in general 
not as strong as in the ‘classical’ setting as described in Section 1. The question is, how to 
compare the difference between the given data and the hypothetical case of independence. 
In the classical setting we have compared probabilities, but since it has been probabilities of 
Bernoulli random variables, we have compared expected values as well. This latter concept 
carries over to the more general case. 
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Let d : Sh+i x Sh+i —>■ M+ be a pseudo-metric, that is, for every a, n, p G Sk+i we have 

(i) d(c r, a) = 0 

(ii) d(a, 7r) + d(7r, p) > d(<r, p) 

Furthermore, let w : d(Sh+ 1 , S'/i+i) —* [0,1] be a monotonically decreasing function such 
that w{ 0) = 1. 

Ew (d(ll(X n , X n+1 ,..., Xn-t-ii), LI (Y n , Y n+ 1 ,..., E n -i-/i)^ 

- ^ w (d(7T,a))p(n(x n ,x n+1 ,...,x n+fc ) = tt) -p(n(y n ,y n+1 ,...,y n+ft ) = u) 

(17) 

is called average weighted ordinal pattern dependence (AWOPD). 

The AWOPD can be normed as in (JT]) . In applications it is sometimes more convenient 
to work without any norming: in the classical setting one compares the number of coincident 
patterns with the estimate of q times the number of observed patterns, that is, the average 
number of coincident patterns one would expect under independence. Let N be the number 
of observed points. In the new setting one compares the AWOPD-value 

N-h 

n(xj, x j+ 1) •••) x j+h)i n (z/j, Uj+ 1) ■••5 yj+h) s j' s j 

3 =1 

with the comparison value , which is the (plug-in) estimate of 

Y, w{d{*,a))p(ll{X n ,X n+x ,...,X n+h ) =tt) ■P(u(Y n ,Y n+1 ,...,Y n+h ) = a) 

7r !°'SS/l+l 

times (N — h ). 

The first idea of this section has been to allow a small tolerance in comparing the ordinal 
structure of the two time series (cf. in particular Example 13 .1 1 below). Another approach 
in this direction would be to use a kind of £-band around the respective points of the time 
series. The problem here is in computation. We would lose the benefit which we get from 
analyzing only the ordinal structure, if we checked whether a point is in an £-band around 
another point. And we would have to do this in fact for h + 1 points simultaneously. 

There are various metrics, which can be defined on 5^+1 and which are used in different 
areas of mathematics. For a survey consult Deza and Huang (1998) and Critchlow (1985), 
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Chapter II. The metric of choice depends highly on the application one has in mind. Here, 
we describe two different settings with suitable metrics. 

Example 3.1. Maybe, the most natural choice for a metric is the C-distance: for tt, a £ Sh+i 
define 

h 

dei (a, it) := \tt^ — a^\ . 

j =o 

Using this metric is in line with our interpretation from above. We are still interested (as 
in the first section) in the co-movement of time series, but we allow for a small tolerance. 
We do not have to have exactly the same pattern in both time series; it is enough if they 
are close to each other. 

We emphasize the advantage of the new approach with a real world example: let us 
consider again the relation between the S&P 500 and the corresponding VIX (cf. Example 
12. lip . Since we are dealing with a (generalized) ord©, we analyze positive dependence 
between SPX and -VIX. 

In Schnurr (2014) it was shown that there is a strong ord© between the two time series 
under consideration (up to the order h = 7). Let us consider the time period from 06-12- 
1995 to 05-12-1997 (n = 500) and fix the order h = 6. For small orders the effect is not as 
strong. In the given data sets we find 15 coincident patterns. The classical comparison value 
is 0.7633. This means that if the two time series with their estimated pattern probabilities 
were independent, we would expect 0.7633 coincident patterns. In fact we find 15 of them. 
There is strong evidence for a classical positive ordinal pattern dependence. 

Next we use the 7 1 -metric and the weight function 

w := 1 {o} T" 0.75 • 1{2} + 0.50 • 1 { 4 } + 0.25 • 1{6}- 

Recall that the f 1 -distance on Sh+i is always an even number. We compare the AWOPD- 
value with the comparison value: the AWOPD-value is 101.5. Keep in mind that here not 
only the 15 coincident patterns are counted, but also various almost coincident patterns 
do count towards this score. The comparison value is in this case 13.5. The advantage of 
our new approach can be emphasized by analyzing a noisy version of the time series. We 
calculate the realized variance V of the first time series (S&P500) and add to it a white 
noise sequence of i.i.d. Gaussian random variables with mean zero and variance V, that is, 
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the variance of the noise is as big as the variance of the data. We have simulated this 100 
times. For 81 of the new noisy time series we found not a single coincident pattern between 
these time series and the original -V1X data. Using weighted ordinal pattern dependence 
with d and w as above we get a mean of 8.4125 for the AWOPD-value, which is significantly 
higher than the mean of the comparison value 3.983 (sd=0.4933). Even under a strong noise 
the AWOPD approach still detects the positive dependence. This example shows how the 
tolerance which we have included in the comparison makes our method more robust. 

While the metric in the example considered above is quite canonical, the (optimal) 
choice of the weight function is an interesting open question. With our linear function 
above we have been quite successful, although it was chosen ad hoc. 

On some occasions, it might not be co-movement we are interested in. In the following 
example, we use the metric in order to distinguish between ‘order’ and ‘chaos’. 

Example 3.2. Sometimes one might not be interested in co-monotonic or anti-monotonic 
behavior. Some time series, in particular in biology/medicine have times of regular behavior 
and others of, say, chaotic or turbulent behavior. It could be of interest to analyze whether 
the chaotic parts within two time series start and stop at about the same time. A structural 
break would then mean that one of the series starts its chaotic behavior while the other 
one is still in a regular regime or the other way around. 

First we have to answer the question how to measure ‘regular’ behavior in terms of 
ordinal patterns. Secondly, we will introduce a (pseudo-)metric which describes how far 
away a pattern is from being regular. Finally we have to check whether regular parts and 
chaotic parts appear at the same time in given time series. 

Let us start with the first question: it is doubtless that the pattern in Figure 10 shows 
a regular behavior (a time of growth) while the pattern in Figure 11 shows in a certain 
sense chaotic behavior, that is, it changes direction all the time. We want to make this 
mathematically tractable. The monotone patterns (0,1,..., h ) and ( h , h — 1,..., 0) are from 
our point of view most regular. To every pattern in Sh+i we assign the value 

7r i —y c(tt) := min i(vr, (0,1,..., h)), dii(7i, (h, h — 1,..., 0))}, 

that is, we measure how far away the pattern is from the two most regular ones. Again we 
use the f' 1 -distance, but in a different way than in our above example. 
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Figure 10: The pattern (5,4, 3, 2,1, 0). Figure 11: The pattern (1, 3, 5, 2,4, 0). 

A big value of c(tt) means that n is ‘chaotic’. Chaotic patterns should be close to 
other chaotic patterns while regular patterns should be close to other regular ones. This is 
obtained in the following way: we use a metric on the space c(Sh+ i) Q M + which takes the 
order structure of M + into account. W.l.o.g. we use the Euclidean distance d E - Since we 
want to measure the distance between patterns, we pull this metric back via the function 
c: 

d(7r,a) := d E (c(n), c(a)) 

It is easy to check that d is a pseudo-metric on Sh+i- Unlike in the case of a (proper) 
metric, d(a, n) = 0 does not imply a = n. For example, the distance between the patterns 
(0,1,..., h) and (h,h — 1,..., 0) is zero. The last step is identical to our previous example: we 
use a monotonically decreasing weight function in order to guaranty that a similar behavior 
results in a big AWOPD-value while a different behavior results in a small AWOPD-value. 
Using this method of analysis on real data is part of ongoing research. 

The main difference between the two examples is that different patterns are thought of 
as being close to each other. Our above approach hence gives us a lot of flexibility in terms 
of the kind of dependence which can be analyzed. 

3.2 Limit Theorems and Structural Breaks in the Generalized 
Setting 

We estimate the AWOPD by the sample analogue 

\ n—h 

b n = - w(d(U(Xj,X i+h ), n (Yj,Y i+h ))) - ^2 w(d(7T, cr))gx(7r)gy(cr), 

i=l n,a£Sh +1 
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where qx and q Y are defined as in (fill) and (TT2]h respectively. In order to derive the 
asymptotic distribution of D n , we note that D n is a functional of the (2 (h + 1)! + 1)- 
dimensional random vector 

^ n—h \ 

-^2w(d(U(Xi ,.. .,X i+h ),U(Yi, .. .,Y i+h ))), (q x (n)) neSh+1 , (q Y (n)) 7rG s h+1 ■ 

n i =i / 

We will now derive the asymptotic distribution of this random vector. 

Theorem 3.3. Under the same assumptions as in Theorem \2.f\ 

^ n—h 

— ^ ^ '?n((i(II(A7, • • • , -^C.+h); n(^i) ■ ■ ■ ; h^_|_/j))), (qx (^^irGSh+i ; (^'(^O^eS^-i-i 
i =1 

is asymptotically normal with mean vector 


(F,(w( d(Y\(X, 


and covariance matrix (1 /n) ■ S, where 


£ 


a b', 
bi Sn 
^ b 2 S21 



S 12 
S22 1 


(18) 


Here Sn, Si 2 , and £22 are the (h + 1)! x (h + 1)! matrices with entries defined in (1T41) . 
03, and m, an d a e an d t*i, b 2 G M (h+1)! are defined as follows 


OO 


a = Cov (tc(d(II(Xi,... 

,X 1+h ),U (Yy... 

,Yi +h ))), 

w(d(Yl(X l , 

1 ■ ■ ■ , Xi+h), 11 ( 17 , 


t >i ( 7r ) = Cov (tc(d(II(Ad,... 

i =—00 

,X 1+h ),U(Y 1 ,... 

, *l+h))), l{n(X i ,...,X i+fe )=7r}) 

OO 

b 2 (7r) = Cov (tc(d(II(Ad,... 

,x 1+h ),n (w,... 

, *i+/i))), l{n (Y i ,...,Y i+ h)=v}) 


i =—00 


Proof. This follows from the multivariate CLT for functionals of mixing processes, which 
can be derived from Theorem 18.6.3 of Ibragimov and Linnik (1971) by using the Cramer- 
Wold device. □ 
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Theorem 3.4. Under the same assumptions as in Theorem 2.4 


V^(D n - AWOPD ) -> iV(0,7 2 ), 


where the asymptotic variance 'j 2 is given by the formula 


7 2 = aSa, 


with S as in 03 and 


a = 


V 


L <j£Sh+l 


7r ^‘S'h+l 


w(d(a,7r))qx(a) 

(TGSh + l 


y 

T £'Sh+l / 


Proof. This follows from Theorem 13.31 and the delta method, applied to the function g : 

Jg)2(/l+l)! + l ]]^ gj Ven ^ 

g(u, (v n ) ne s h+1 , (w„) ve s h+1 ) =u- ^ w(d(n, <r))v n w a . 

7T,cr£Sh+i 

Note that a = Vg(E(w(d(U(X u ..., X h+1 ), fI(Yi,..., Y fc+ i)))), (qx(^))-Kes h+1 , OwM^e^+i)- 

□ 


Finally, we propose a test for structural breaks in the AWOPD rejecting for large values 
of the test statistic 

k 


W n = max 

0 <k<n—k 


-rY t \ w ( rf ( n ( x - • • • > *i+h),n(Yi, • • •, Y i+h ))) 


-Vw (d( n(Xi ,..., x i+h ), n (Yi,..., Y i+h ))) 

n 


i —1 


(19) 


Theorem 3.5. Under the same assumptions as in Theorem \2.4\ and under the hypothesis 
of no structural break, 


Wn 


V 


a sup \W(X) - AW(1)|, 

0<A<1 


where a is defined as in Theorem \3.3[ 
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Proof. The proof follows along the lines of the proof of Theorem 12.71 We introduce the 


process 


[nA] 


W n { A) = 


V U (d(n(JSQ, ..., X i+h ), IKT; 


..... Vi+O)) 


- y; w (d( n(Xi,.... X i+h ), n(Y-„.... Yi+k))) 

n “ 


i =1 


[nA] 


^ W (d( U(X h ..., X i+h ), n (Yi ,..., Y i+h ))) 

i =1 

r \I ^ 

■ -F= J2 w {d{ U(Xi ,..., X i+h ), n (Yi ,..., Y i+h ))) 

n Jn z —' 


2=1 


As in the proof of Theorem 12.71 we can show that (W / n (A)) 0 <A<i converges in distribution 
to the process ^/a(W( A) — AW(1))o<a<i- □ 


4 Proofs 

Let us first show that the time series in Example 12.21 are 1-approximating functionals: In 
part (i) we have considered a MA(oo)-time series X. We define the functions f m : M 2m+1 —> 
R by fm{zi-m , • • •, Z i+m ) = EJLo oijZi-j. Thus we obtain 


E\Xi — ■ ■ ■ , Z i+m )\ — E 


a jZi ~j 


j=m+l 

oo 


1/2 


1/2 


< ( e { E 




Y. a i ) yVar(Zi). 

Vj=m+1 


1/2 


Hence, (W)i>i is a 1-approximating functional with coefficients a m = 

In part (ii) we have considered the baker’s map. We will now show that ( X n ) n > 0 is a 
functional of an i.i.d. process. It is well-known that for almost every oo G [0,1], there is a 
unique dyadic expansion 


oo = 


UXJ ry 

\X 

21 ’ 


3 = 1 


where Z 3 = Zj(uo) G {0,1}. Moreover, the random variables {Zf)j> i are i.i.d. and P(Z,; = 
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0) = P(Zi = 1) = 1/2. Note that 


r» = E% = E vz -y 


-1 


3 = 1 
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3 =~°o 


We then define , z m ) = 7 -=_ m 2 J ',Zj), and thus we obtain 


£|X 0 -/ m (Z_ m ,...,Z m )| — E 


Y. z i 2 ’ 




o=i 


o=i 


< 


* E 


\ j = m -\-1 


2i 


= y l 


2 TO +1 


Hence, (X n ) n > 0 is a 1-approximating functional of the i.i.d. process (Zj) jeZ with approx¬ 
imating constants a m = ||y||L/2 m+1 . The proof for the claim of part (iii) is similar and 
hence omitted. 

The following lemma is used in the proof of Theorem 12.41 


Lemma 4.1. Let i be a 1-approximating functional of the process (Zi) i& i with 

approximating coefficients (a m ) m >i. 

(i) Assume that the distribution functions of X, — X x is Lips chit z- continuous, for any 
% G {1,..., h + 1}. Then, for any permutation tt, 


l{n(Xi,x i+ 1 ,...x i+h )=w} 

is a 1-approximating functional with approximation constants (0(y / a^)) m >i- 

(ii) Assume that the distribution functions of Xf — Xi, and of Y t — Y 1; are Lipschitz- 

continuous, for any ie{l,...,h+l}. Then, 


Uu(X i ,X i+ 1 ,...X i+h )=U(Y i ,Y i+ 1 ,...Y i+h )} 

is a 1-approximating functional with approximation constants i. 

Proof. We only present the proof of part (ii). The proof of part (i) follows the same lines. 
Let m > 1 and define (xj m) , Y^) = / TO (Zj_ m ,..., Z i+m ). Then, the following inequality 
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holds 


^-{n(Xi,X i+l ,...X i+h )=n(Yi,Yi + 1 ,...Y i+h )} ^{U(X^ m \x^,...X^)=n(Y^ m \Y^ 

h h 

- 1 {\ X i + j - X ^\> e } + 5Z 1 {\ Y i + j - Y < g >\> e } 

3=0 j =0 

+ l {\ X i + j - X i + k \< 2 e } + 1 {| - ^i+fe | <2e} - 

0<j^k<h 0<.?7^A:</i 

Thus, by stationarity, we obtain 


]-{Tl(Xi,Xi+i,...X i+ h)—Tl{Yi,Yi + i,...Y i+ h)} ^m<X {m) X ^ X^)=TUY^ m ^ Y^ + m b\ 

>- V i 5 i+l ' % ’ i+l i+n, /J 

< (h + 1)P(|X! - X{ m) | > e) + (h + l)P(|Yi - Y^l > e) 

+ ^ P(|X,--X fc | <2e)+ ^ P{\Yj -Y k \< 2e) 

1 ^j^k<h 

<2(h+l)— + 2(h+l)hCe. 


Choosing e = Jaff, we thus obtain 


E 


^-{n(Xi,x i+ 1 ,...x i+h )-Ti{Yi,Yi + 1 ,...Yi + h)} ^{n(x (m) v*- 77 ^ x( m b=nfy. (m) y^ 7 ") y( m )n 

t V i 5 i+l ' i ’ *+l i-\-h ' J 




thus showing that l{n(x i ,x i+1 ,...x i+Jl )=n(y i ,y i+1 ,...y i+fe )} is a 1-approximating functional. □ 

Proof of Theorem \2.14\ We define the function / : R 2W —y M by /(x, y) = Yli=i x i Di-> w i iere 
x = (xi,... ,Xh\), y = (yi, ... ,Vhi)- f i s everywhere differentiable, with partial derivatives 
-£yf(x, y ) = yi and -^-/(x, y) = x % . Thus, denoting by V x / the vector of partial derivatives 
of / with respect to the ^-coordinates, we obtain 

V/(x,j/) = f ] (x,y) = ( y 

V Vyf ) V X 

Observe that +, = f((q x (^))nes h , ('fyMWJ, and that q = /(gx,?y)- Hence, we may 
apply the delta method, which yields y/n(p n — p) —* iV(0,7 2 ), where 

7 2 = (V/(g x ,gy)) T SV/(gx,gy) 

- <*& f Sl1 El2 ) f*' 

y S 12 5 j 22 y y qx 

= qy^nqY + 2qxTii2qy + q^x^Tiqx- 


Using (fT4lh ( I15p . and (1T6l) . we then obtain the final formula for y 2 . 


□ 
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Proof of Theorem 2.1. We introduce the process 


1 


[nA] 


Tn ( A ) = 


+h )=n(Yi,...,Y i+h )} 


- Pn ) , 


i= 1 


which we can rewrite as follows 

[nA] 


Tn( A) = ^]T(l { 

v n '—f 

i=i 


[nA] 


^ (VPA-Ai 


n(x i ,...,x i+fc )=n(y i ,... ! y i+h )} - p) 
. + h)=n(y i ,...,y i+h )} - p) 


[nA] 


n 


iPn-p)) 


[n A] J_ \ - / 

vAf ( PW. 

Z=1 


n 

Ml 

n 3 / 2 


x i+/l )=n(y i ,...,y i+h )} 


p) 


£ i 


{n(x i! ...,x f+fc )=n(y i ,... ! y i+h )}- 


i=n — h-\-l 

Note that ([n A]/n 3/2 ) EL-w converges to zero in probability, 

and that [nA]/n converges to A. Thus, by the invariance principle for the partial sums 
of the indicator variables l{n(x i ,...,x i+h )=n(y i ,...,y i+ / l )}j we obtain immediately that the term 
(1 /y/n) (l{n(x i ,...,x j+ fc)=n(y i ,...,y i+h )}-p) converges in distribution to a Brownian motion 

with variance a 2 . Thus, by the continuous mapping theorem, we obtain convergence of 
(T„(A)) 0 <a<i towards cr(W(A) — AW(1)). Another application of the continuous mapping 
theorem yields that 

sup |T n (A)| —> cr sup |W(A) — AW(1)|. 

0<A<1 0<A<1 

Finally, we observe that T n = sup 0<A<1 _h. |T n (A)|, and that 

— — n 

1 I - I 

= 2 ^ \l{n(x i ,...,x i+h )=n(Y i ,...,Y i + h )} ~ Pn\ ■ 

i=n-h -\-1 

As the right hand side converges to zero in probability, we have finally proved that T n 
converges in distribution to cr sup 0<A<1 |W(A) — APF(1)|. □ 


sup |T n (A)| - sup |T n (A)| 

0<A<1 0<A<1—- 


5 Conclusion 

In the present paper we have introduced a new method to detect structural breaks in the 
dependence between two time series. To this end we have used the concept of ordinal pat¬ 
tern dependence which has been introduced in Schnurr (2014). While that article contained 
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mainly a case study, here, we have presented the technical framework and generalized the 
concept substantially by using distance functions on the space of ordinal patterns. This 
allows us to analyze various kinds of dependence in future research. 

Our approach has several advantages compared to other ways of analyzing structural 
breaks within the dependence: the method is robust against measurement errors or small 
perturbations of the data. The intuition behind the concept is clear and there are quick 
algorithms in order to carry out the analysis. Let us emphasize that we do not need our 
random variables X t to have second moments which is a standard assumption for all tests 
which are based on correlation. 

It is important to note that even the classical ordinal pattern dependence does not 
measure the same phenomena as correlation measures. It is not in the scope of the present 
paper, but let us mention that we have analyzed data from medicine as well as hydrology 
which admit an ord© without showing a significant positive correlation and those with a 
strong positive correlation without showing ordinal pattern dependence. This statement 
remains true, comparing the ord© with kendall’s tau or spearman’s rho. 

Dealing with financial data we have seen that our test works in practice. One could 
have other applications in mind. Since the method is scale free one can compare data 
coming from entirely different sources. As an example one could analyze the dependence 
between asset data and the heart rate of a trader. 
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